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Abstract 

Let G be a classical algebraic group, X a maximal rank reductive 
subgroup and P a parabolic subgroup. This paper classifies when 
X\G/P is finite. Finiteness is proven using geometric arguments 
about the action of X on subspaces of the natural module for G. 
Infiniteness is proven using a dimension criterion which involves root 
systems. 

1 Statement of results 

Let G be a classical algebraic group defined over an algebraically closed 
field, let X be a maximal rank reductive subgroup, and let P be a parabolic 
subgroup. The property of finiteness for X\G/P is preserved under taking 
isogenies, quotients by the center of G, connected components and conju- 
gates (see Lemma POl for a precise statement). Thus, if desired, we can 
specify only the Lie type of G. Similarly, we can specify only the conjugacy 
class of X and P; thus we usually give the Lie type of X and describe P 
by crossing off nodes from the Dynkin diagram for G. For the purpose of 
classifying finiteness, it suffices to consider only those X which are defined 
over Z. 

A subgroup X is spherical if X\G/B is finite for some (or, equivalently, 
for each) Borel subgroup B. For each classical group we list in Tabled those 
maximal rank reductive spherical subgroups which are defined over Z. We 
first describe the notation which is used for the list, and for the rest of the 
paper, and then describe how the list is obtained. We write X = A n A„{T\ if 
X is a group of Lie type A n + A m which has a 1-dimensional central torus, 
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2 Double Cosets 

Table 1: Maximal rank reductive spherical subgroups defined over Z 



X < G X < G 



A n A m T\ 


< 


A-n+m+l 


B n D m 


< 


B n -\-m 


a c 


< 


a 




< 


B n 


C n -\Ti 


< 




D n D m 


< 




Au-xTi 


< 


C n 




< 





and we use similar notation for other subgroups. If G equals D n we adopt a 
notational convention to distinguish between certain subgroups of the same 
Lie type which are not conjugate. In G = SO(V) any factor denoted by 
D ni (or SC^nJ acts as SO(Vi) for some decomposition V = V\ _L V 2 and 
any two factors denoted by A ni Ti (or GL„ 1+ i) act as GL„ 1+ i on a pair of 
totally singular subspaces E and F such that V = (E © F) _L V 2 (in partic- 
ular dimE = dimF = n\ + 1 and E and F are in duality). We allow the 
notation A , B and Co to denote trivial groups and D\ to denote a group 
which is a 1-dimensional torus. We now describe how Table ^ is obtained. 
Kramer jH] classified the reductive spherical subgroups in characteristic 0. 
The subgroups on Kramer's list were shown to be spherical in all character- 
istics by Brundan [H] and Lawther |||. Duckworth 4\ showed that this list 
is complete for maximal rank subgroups. 

In Theorem^ we use the notational conventions just described, as well 
as the following. We write X = Li if X is conjugate to a Levi subgroup 
obtained by crossing off node % from the Dynkin diagram of G (we number 
the nodes of the Dynkin diagram as in [2]). The meaning of X = L ilti2 and 
P = Pi is similar. 

Theorem 1. Let G be a simple algebraic group of type A n , B n , C n or D n , 
let X be a maximal rank reductive subgroup defined over Z and P 7^ G a 
parabolic subgroup. Then X\G/P is finite if and only if X is spherical or 
one of the following holds: 

(i) G = A n , 

(a) P e {P u P n }, 

(b) X = A ni A n2 A n3 T2 and P = P, t for some i; 

(ii) G = B n , X = A ni B n2 Ti and P E {P u P n }; 

(iii) G = C n , 

(a) X e {C ni ■ ••C nr , A ni C n2 ■ ■■C nr T l } and P = P x , 

(b) X G {C ni C n2 C n3 , C ni C n2 T\, A ni C n2 T\\ and P = P n ; 

(iv) G = D n , 

(a) G = D 4 , (X,P)G{(L 2 , 3 ,P 4 ), (L2.4, Ps)h 

(b) X e {A ni D n2 T lt A ni A n2 T 2 } and P = P x , 
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(c) X e {D ni D n2 D na , A ni D n2 Ti} and P e {P n _ 1; P n }. 

2 History and preliminaries 

The problem of identifying finite double coset collections has been studied 
by a variety of authors, usually in the context of some other problem. The 
spherical subgroups discussed above provide one example of this study We 
briefly describe another example here, and refer the reader to j3] and ^T] 
for fuller discussions. 

Example 2.1. We describe irreducible finite orbit modules. Let V be a 
finite dimensional vector space and let X be a closed, connected subgroup 
of G = GL(V) such that X has finitely many orbits on V and V is irreducible 
under X. Such modules were classified by Kac j7] in characteristic and 
by Guralnick, Liebeck, Macpherson and Seitz [Hj in positive characteristic. 
This work was representation theoretic, however it is related to the double 
coset question studied in the present paper. Note that X is a reductive 
group and that X\GL(V)/Pi is finite where Pi is the stabilizer of a 1- 
space. The authors of jE] mentioned this connection with double cosets, 
they classified finiteness for X\GL(V)/Pi where 1 < % < dimV and they 
established Theorem ^(i) using rather different arguments from those that 
appear in the present paper. 

The following lemma provides basic reductions in our double coset ques- 
tion. 

Lemma 2.2. Let G be a group and let X and P be subgroups. Let Z be 
the center of G, suppose that Z < P and let X , G and P be the images 
of X, G and P, respectively, under the map G — > G/Z. Let K be a finite 
normal subgroup of G and let X, G and P be the images of X, G and P, 
respectively, under the map G — > G/K. Let g,h 6 G. The following are 
equivalent: 

(i) \X\G/P\ < oo, 

(ii) \X\G/P\ < oo, 

(iii) \X\G/P\ < oo, 

(iv) IgXg-^G/hPh- 1 ] < oo. 

Let G be an algebraic group and X and P be closed subgroups. Denote by 
G° , X° and P° the identity components of G, X and P respectively. If 
X\G/P is finite then so is X°\G°/P°. 
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Proof. These statements can all be proven in an elementary fashion. The 
final statement uses only the fact that X° and P° are normal subgroups of 
finite index in X and P respectively. □ 

This Lemma justifies assumptions implicit in the statement and in the 
proof of Theorem ^ The final statement of the Lemma will be applied to 
recover finiteness results in SO(V) from arguments made involving 0(V). 

Remarks 2.3. We fix some notation for the rest of the paper. We let G 
be a classical algebraic group defined over a fixed algebraically closed field. 
If G is of type B n , C n or D n we will, when convenient, assume that G is 
one of S02n+i, Sp 2n or SC>2n respectively. We will often replace G = A n 
with G = GL n . In all cases G has rank n (note that this means replacing 
P n in A n with P n -i in GL n ). We denote by X a maximal rank reductive 
subgroup of G and by P a parabolic subgroup of G. 

We fix some terminology since usage varies in the literature and refer the 
reader to ^2] or [S] for further details. To each possibility for G we associate 
a natural module V and a bilinear and quadratic form (we take these forms 
to be identically zero if G — GL n ). A subspace of V is totally singular if 
each form is identically zero on the subspace. If P is a parabolic subgroup 
then it equals the stabilizer of a (partial) flag of totally singular subspaces of 
V and we identify G/P as a collection of flags of totally singular subspaces. 
Thus, a spherical subgroup has a finite number of orbits on the set of flags 
of totally singular subspaces. 

Let G equal S0 2n - Then two totally singular n-spaces are conjugate 
under G if and only if their intersection has odd codimension in each space. 
Thus, there exist two G-classes of totally singular n-spaces which we identify 
as Gj P n -i and G/P n . If n is odd then L n _i is conjugate to L n under G, but 
this is not the case if n is even. These facts are relevant to Theorem ^(iv). 

Let V be the natural module for G. We write V = V\ _L V 2 if V = Vi©V 2 
and each element of V\ is orthogonal to each element of Vi- Given such a 
decomposition we define Cl(V^) to equal GL(V^), 0(V$) or Sp(Vi) as G equals, 
respectively, GL(V), SO(V) or Sp(V). We let Cl(V-)° be the connected 
identity component of Cl(V^). If C1(K) = O(^) then Cl(^)° = SO(V*) and 
otherwise Cl(^)° = Cl(^). 

3 Finiteness 

In this section we will prove those parts of Theorem^which assert finiteness. 
For the convenience of the reader we list in Tabled the specific result which 
covers each case. 
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Table 2: Finiteness Cases 



G Cases 



Proof 



A n all cases 

B n the case with P = Pi 



Corollary 13.61 
Corollary 13.61 



the case with P = P n 
C n all cases with P = Pi 



Corollary EJH 



all cases with P = P, 
D n G = D4, all cases 



Corollary 13.61 
Corollary EH 
Corollary EH 



(X,P) = (A ni D n2 T 1 , Pi) 
(X,P) = (A ni A n2 T 2 , Pi) 
(X,P) G {D ni D n2 D na , A ni D n2 Ti} x {P r 



Corollary 13.61 
Lemma 13.121 
P n } Corollary EH 



The next Lemma is not used immediately, but we place it here to pre- 
serve the line of argument later. 

Lemma 3.1. Let G = S0 2n end let X = GL n . Then X acts transitively 
upon the set of definite 1-spaces in V and has a finite number of orbits upon 
the set of all 1-spaces in V . 

Proof. Let Ni be the stabilizer of a definite 1-space in G. Then the first 
claim is equivalent to having G = XNi . In this form the first claim is proven 
in PU]. The second claim follows from the facts that GL„ is spherical in G 
and that every 1-space is either singular or definite. □ 

Remark 3.2. We fix some notation for the next few Lemmas. Let G be one 
of GL(V), 0(V), SO(V), or Sp(V) and fix a decomposition V = V x JL V 2 
such that X = X X X 2 for subgroups X^ < Cl(T^). Let P be a maximal 
parabolic subgroup of G and identify G/P as a collection of totally singular 
subspaces in V. For i G {1, 2} let ^ : V — > Vi be the natural projection. 

Lemma 3.3. Let the notation be as in Remark \3. 6 A In addition let (3 and 
if be, respectively, the bilinear and quadratic forms associated with G. 

(i) Letu, v, x, y G V such that f3(u,v) = /3(x,y) = 0. Then f3(iTiU, ^v) = 
Pfax, niy) if and only if (3(ir 2 u, n 2 v) = (3(n 2 x, n 2 y). 

(ii) Let u and x be two singular vectors with <f(7r 1 u) = ^(^x). Then 
(p(-K 2 u) = <p(n 2 x). 

Proof. Decompose u as u = tt 1 u + tt 2 u, decompose v, x, and y similarly, and 
use the fact that V\ and V 2 are orthogonal to each other. □ 
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Lemma 3.4. Let the notation be as in Remark \3. £1 with the additional as- 
sumptions that G = Cl(V) and X2 = C1(V2). Two totally singular subspaces 
of the same dimension are conjugate under X if and only if their projections 
to V\ and intersections with V\ are simultaneously conjugate under X\ . 

The proof of this statement uses Witt's Theorem applied to X 2 , so, if G 
is an orthogonal group, one cannot replace C1(V2) = 0(1^) with C1(V2)° = 
SOCV2). We will use Lemma E21 to translate finiteness results to SO n . We 
note that finiteness results do not always translate between O n and SO n 
in an obvious fashion. For example, the collection L 2 ^\SOs/ P4 is finite 
whereas L 2j 3\0 8 / P4 is infinite. 

Proof. It is easy to see that if two subspaces are conjugate under X, then 
their projections to V\ and intersections with V\ are simultaneously conju- 
gate under X\. 

Conversely, let W and W be totally singular subspaces of the same 
dimension such that x\(yVC[V\, tt-^W) = (W'nVx, t^W) for some x x e X 1 . 
Replacing W with x{W we may assume that (W fl Vi, tt-^W) = (W fl 
Vi, ttjW'). Note that dimVT n V 2 = dimW n V 2 . Define the following 
dimensions: 

a = dim W n V x = dim W' n V u 
c = dim W H V 2 = dim W n V 2 , 
b = dim W — a — b = dim W — a — b. 

We will pick bases for W and W as follows: 

W : w t ,...,w a , w a+ i, w a+b , w a+b+1 , w a+b+c , 
W : Wl ,...,w a , w' a+1 ,...,w' a+b , w' a+b+1 ,...,w' a+b+c . 

We start by picking a basis wi, . . . , w a of W fl V\ = W fl V\. Extend 
this with elements v a+ i, . . . ,v a+b to a basis of 7r 1 W / = it^W' . For each 
i G {a + 1, . . . , a + b} pick Wi G W and G W 7 ' such that ir^i = t^iW^ = v j. 
Let w a+ b + i, . . . , w a+ b +c and ty^ +6+1 , . . . , w' a+b+c be bases for W(lV 2 and VT'n 
V 2 respectively. Then each of {w a+u . . . , w a+b+c } and . . . , w' a+b+c } 

is a linearly independent set, whence each of {ir 2 w a +i, . . . ,ir 2 w a +h+c} and 
{7r 2 w' a+1 , . . . , 7r 2 u^ +b+c } is a linearly independent set. 

Let x 2 be the linear map from the subspace (ir 2 w a+ x, . . . , 7r 2 w a+b+c ) to 
( 7T 2 w a+n ■ ■ ■ 1 7l 2 w 'a+b+c) which takes each n 2 Wi to 'n 2 w' i . 

If G = GL(V) then one may extend x 2 to an element x 2 G GL(T^) = X 2 . 
Note that x 2 Wi = w[ for each i G {a + 1, . . . , a + b + c}. This finishes the 
proof for the case G = GL(V). 

If G G {0(V), Sp(V)} we show that x 2 is an isometry from the subspace 
(n 2 w a+1 , Ti 2 w a+b+c ) to (7r 2 w' a+1 , Tr 2 w' a+b+c ). Once this is done, Witt's 
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Theorem implies that we may again extend x 2 to x 2 G Cl(T^) = X 2 and we 
will be finished. If p 7^ 2 or if G is symplectic, then Lemma l3.3l fi) shows 
that (3{n 2 Wi, n 2 Wj) = /3(7r 2 w-, ir 2 w 'j) f° r all a + 1 < i,j < a + b + c, whence x 2 
is an isometry. If p = 2 and G is orthogonal, then Lemma EHW ii) shows that 
(p{n 2 Wi) = <p(Tr 2 w' i } for a + 1 < i < a + b + c, whence x 2 is an isometry. □ 

Corollary 3.5. Let the notation be as in Remark 13.21 with the additional 
assumption that X 2 equals Cl(T^) or C1(V2) . Then X\G/P is finite in the 
following cases: 

(i) Xi has a finite number of orbits upon the set of 1-spaces in V x and 
P = Pi, 

(ii) G = GL(V), Xi has a finite number of orbits upon the set of all flags 
in V\ and P = P{ for some i, 

(iii) G = GL(V) = GL n , X± has a finite number of orbits upon the set of 
subspaces of V\ with codimension 1 and P = P n -\. 

Proof. By Lemma \2. 21 it suffices to prove Corollary 13 . 51 with the assumption 
that G = Cl(V) and X = Cl(V 2 ). By Lemma l3~l it suffices to show that X x 
has a finite number of orbits upon the set {{W H V\, ttiW) \ W G G/P}. 
Note that W fl V\ < tt±W is a flag. It is easy to verify in each case that X\ 
has a finite number of orbits on the set. □ 

Corollary 3.6. The double coset collection X\G/P is finite in the following 
cases: 

(i) G = GL n , (a) X has no additional restrictions (other than our stand- 
ing assumptions) and P G {Pi,P n _i} or (b) X = GL ni GL n2 GL n3 
and P = Pi for some i, 

(ii) G = S0 2n +i; x = GL m S0 2 „ 2 +i and P = P\, 

(iii) G = Sp 2n , X G {GL ni Sp 2n2 • • • Sp 2nr , Sp 2ni • • • Sp 2nr } and P = P x , 

(iv) G = S0 2n , X = GL ni S0 2n2 and P = P x . 

Proof. In each case let V be the natural module for G and fix a decomposi- 
tion V = Vi±V 2 such that X = X X X 2 with X x < Cl(V x ) and X 2 = C\(V 2 )°. 

For case (i)(b) note that X x = GL ni GL n2 is a spherical subgroup of 
GL ni+ri2 = Cl(Vi) and apply Corollary I3.5l fn). For case (i)(a) apply Corol- 
lary |33](i) if P = P x , apply Corollary 13.51 (iii) if P = P n - X , and, in both 
cases, induct on r. 

Let G = Sp 2n . By Corollary 13.51 (i) it suffices to show that X x has 
finitely many orbits on totally singular 1-spaces in V (note that all 1-spaces 
are totally singular in this case). This is immediate if X x equals GL ni or 
Sp 2ni Sp 2n2 since these subgroups are spherical in Cl(Vi)°. The general case 
follows by induction on r. 
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If G is orthogonal, then X\ = GL ni and the result follows by combining 



Lemma 3.7. Let the notation be as in Remark VS. "A with the additional 
assumption that V is a symplectic or orthogonal space. Let W be a maximal 
totally singular subspace of V and let {jijW) 1 - be the perpendicular space 
taken within Vi. If dimV is even then dim(7r i W')" L /(W' fl Vi) equals 0. If 
dim is odd then dim(7r i W / )" L /(W / fl Vi) equals or 1. 

Proof. Since V\ is orthogonal to Vi it is easy to show that WdVi < (iiiW)- 1 . 
We have dim W equals n and dim V equals 2n or 2n + 1. Set dj = dim WnVi. 
For i equal to 1 and 2 the inequality dim(7TjW / )- L > dimW 7 fl Vi becomes, 
respectively, dimVi — (n — a 2 ) > a\ and dim V 2 — (n — ai) > a 2 . If dimV^ 
is even, then the sum of these last two inequalities is an equality; if dim V 
is odd, then the sum of the left sides is 1 greater than the sum of the right 
sides. □ 

Corollary 3.8. Let the notation be as in Remark \3. t 'A with the additional 
assumptions that G is not GL(V) ; that X 2 equals C1(V2) or C1(V 2 ) and that 
P = P n . Then X\G/P is finite in the following cases: 

(i) dimV^ is even and Xi has a finite number of orbits on the set of totally 
singular subspaces ofV\, 

(ii) dim V is odd and X\ has a finite number of orbits on the set of pairs of 
subspaces (Wi, W 2 ) such that W\ < W 2 < V\, W\ is totally singular, 
W 1 < W 2 L and dim(W 2 /Wi) < 1. 

Proof. By Lemma l2~2l we may assume that G = C1(V) and X 2 = C1(V). By 
Lemma 13.41 it suffices to show that X\ has a finite number of orbits upon 
the set {(W n V^W) \ W G G/P}. Given subspaces W, W < V and 
x\ G X\ we have Xi7r l W = 7r l W if and only if xi(tt 1 W) ± = (tt 1 W') ± , where 
we take the perpendicular space within V\. Thus, it suffices to show that X x 
has a finite number of orbits on the set {(W H Vi, (ti-^W)^) \ W G G/P}. 
By Lemma ET71 we see that {(W n V u (tt 1 W) ± ) | W G G/P} is a subset (or 
may be identified with a subset) of one of the sets given in the statement of 



Corollary 3.9. The double coset collection X\G / P is finite in the following 
cases: 



(i) G = S0 2n , X G {S0 2ni S0 2n2 S0 2n3; GL ni S0 2n J andP G {P n _ ls P n }. 

(ii) G = Sp 2n; X G {Sp 2ni Sp 2n2 Sp 2n3 , GL ni Sp 2n2 , Sp 2ni Sp 2n2 TJ and 



Lemma f3. II and Corollary I3.5l fi). 



□ 



Corollary EU 



□ 



P 
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Proof. Let V be the natural module of G and fix a decomposition V = 
V x JL V 2 so that X = X X X 2 with X x < Cl°(Vi) and X 2 = C\(V 2 )°. Then 
X\ is a spherical subgroup of Cl(Vi)° whence the conclusion follows from 
Corollary E31(i). □ 

Lemma 3.10. Let G = S02 n; let X = GL n < S02„ and let V be the natural 
module for G. Let (v) be a definite 1-space, let X/ v \ be the stabilizer in X 
of (v) and let X( v ) be the connected component of the group induced by X^ 
in SO({v) ± ). Then Xi v ) is a spherical subgroup of SO((v) ± ) . 

Proof. By Lemma f3. II we may calculate Xi v \ where v is any definite vector. 
Let V = E@F such that E and F are totally singular and X is the stabilizer 
in G of this decomposition. Let {ex, . . . , e n } C E and {fx, . . . , /„} C F be 
dual bases. Let v — ex + fx and let GL„_! denote the subgroup of X which 
stabilizes the subspaces (e 2 , . . . ,e n ) and {f 2 , . . . , f n ) and acts trivially upon 
ex and fx. Then (an isomorphic image of) GL n _i is a subgroup of X( v ) 
which proves the claim since SO((f ) ± ) = S0 2 ( n -i)+i- 

□ 

Corollary 3.11. Let G = S02 n +i ; X = GL ni S02n 2 +i; an d P = P n - Then 
X\G/P is finite. 

Proof. Let V be the natural module of G and fix a decomposition V = Vx _L 
V 2 so that X = XxX 2 with X 1 = GL ril < C1°(K) and X 2 = S0 2 n 2 +i = 
Cl(T^) . By Corollary 13. 8l (ii) it suffices to show that Xx has a finite number 
of orbits on the set of pairs of subspaces (Wx, W 2 ) such that Wx < W 2 < Vx, 
Wx is totally singular, Wx < and dim(W / 2 /W / i) < 1. We may partition 
this set into two subsets according as W 2 is, or is not, totally singular. Since 
Xx is spherical in SO(Vi) we see that Xx has finitely many orbits upon the 
subset where W 2 is totally singular. 

Every pair (Wx, W 2 ) where W 2 is not totally singular can be rewritten as 
(Wx, Wi-L(v)) where v a definite vector in V\. Thus it suffices to show that 
Xx has a finite number of orbits upon pairs (Wx, (v)) such that v is a definite 
vector in Vx and Wx < (v) ± is totally singular (where this perpendicular 
space is taken in Vx). By Lemma l3.1| Xx acts transitively upon definite 
1-spaces, whence it suffices to fix v and show that the stabilizer in Xx of 
(v) has a finite number of orbits on totally singular subspaces in (v) x . This 
follows from Lemma f3. 101 □ 

Lemma 3.12. Let G = S0 2n , X = GL m GL„ 2 and P = P x . Then X\G/P 
is finite. 

Proof. Let V be the natural module of G and fix a decomposition V — Vx _L 
V 2 so that X = XxX 2 with X { = GL n% < C\°(V) for each i. 
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Let 7Tj : V — > Vi be the natural projection. We wish to show that X has 
a finite number of orbits on the set {(v) \ v £ V is singular}. By Lemma ETT1 
each Xi has finitely many orbits on 1-spaces in V^. Thus it suffices to show, 
for each singular 1-space (v) that X has finitely many orbits on the set of 
singular 1-spaces whose projections to V± and V 2 are conjugate to n 1 (v) and 
7r 2 (v) respectively. Thus, it suffices to fix an arbitrary singular 1-space (v), 
let Vi = nfl and show that X has a finite number of orbits on the set 

{(v\ + 0LV2) \ a e k, a^O, V\ + av 2 is singular}, (1) 

where k is the ground field. Since V\ + av 2 is singular, we have <p(vi) + 
a 2 ip(v 2 ) = 0, where <p is the quadratic form. Thus, v\ is definite if and only 
if v 2 is. If V\ and v 2 are both definite then a 2 = —ip(vi)/{p(v 2 ), whence there 
are at most two singular 1-spaces of the form (t>i + av 2 ). 

It suffices now to assume that V\ and v 2 are singular and show that X\ 
has finitely many orbits on the set in Equation Let V 2 = P 2 © F 2 where 
E 2 and F 2 are totally singular and X 2 stabilizes E 2 and F 2 . Then v 2 = e + f 
for some e 2 G E 2 , f 2 G F 2 . Since v 2 is singular this implies that /3(e, /) = 0, 
where (3 is the bilinear form. Easy linear algebra shows that there exists 
x 2 G X 2 with x 2 e = ae and x 2 f = af, whence x 2 {v\ +v 2 ) = (vi + av 2 ). □ 

Recall that L it2 denotes a Levi subgroup as described just before Theo- 
rem 

Corollary 3.13. Let G = D A and (X, P) G {(L 2 , 3 , P 4 ), (^2,4, P3)}. T/ien 
X\G/P is finite. 

Proof. This follows most easily from applying the graph automorphism of 
order three to other cases which have been proven finite. For instance 
(X, P) = (L 2 , 3 , Pi) follows from Corollary EH applied to (X, P) = (L li2 , P 3 ) 
(with Li >2 = DiD 2 D 2 ) or from Lemma 13 . 1 21 applied to (X, P) = (L 2 ,4,Pi). 

□ 

The reader who wishes for an instructive, though somewhat painful, ex- 
ercise can prove this Corollary using geometric arguments about subspaces 
of the natural module of P4. 

4 Infiniteness 

We begin by stating a result which gives infiniteness in many cases. 

Theorem 2 (|IJ Theorem 1.3]). If X\G/P is finite then X or L is a 
spherical subgroup of G. 
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Table 3: Infiniteness cases 



G (X, P) 



Proof 



{A ni A n2 A na A ni T 3 } x {Pi | 2 < % < n - 1} Lemma WM 

{B ni D n2 D n3 , A ni A n2 T 2 } x {P 1; P n } Lemma O 

{A ni A n2 C n3 T 2 } x {Pj, P n } Lemma | 

(C ni C n2 C ns C n4 (rii > 1), P„) Lemma | 

(A ni C n2 C n3 Ti (n* > 1), P n ) Lemma | 

(D ni D n2 D m , Pi) Lemma O 

{D ni D n2 D m D n4 } x {P n _i, P n } Lemma O 

{A ni P n2 P n3 (m > 1)} x {P n _i, P n } Lemma O 

{A ni A n2 T 2 (rii > 1)} x {P n _ u P n } Lemma Ol 
with (G, X, P) not as in Theorem Q(iv) (a) 



P r , 



P> r 



Remark 4.1. To finish the proof of infiniteness in Theorem it suffices, 
by Theorem |2J to consider only those P such that L is spherical. Suppose 
that we have fixed such a P. Then it suffices to prove infiniteness for those 
X which are maximal subject to the condition that X\G/P is claimed to 
be infinite in Theorem ^ 

In Table El we list those cases which need to be proven infinite, and 
indicate which result addresses each case. Recall that we allow the notation 
A Q , B Q , Cq and Di unless otherwise noted (but we do not allow D ). 



Remark 4.2. For the remainder of this section we assume that X and 
L contain a common maximal torus, T. For a closed subgroup H which 
contains T we write §{H) for the root system of H defined using T. For 
a closed root subsystem (p of &(G) we set dim<£> = dim H/Z where H is 
a closed subgroup of G such that $(P) = y 9 and Z is the center of H 
(Theorem El also holds if we use dim ip = dimP instead). 

Theorem 3 ([4, Theorem 1.1, Lemma 3.3]). Fori e {1,2} let L { be 
a Levi subgroup containing T and $j its root system. Assume that L\ and 
L 2 are conjugate. If \ dim $x - dim $i n &(X) - \ dim $ 2 n $(L) > then 
X\G/P is infinite. In particular infiniteness holds in the following cases: 

(i) $i and $ 2 are of type B 2 , $i PI &(X) = and $ 2 PI $(L) is of type 
A t . 

(ii) $i and <1 ) 2 are of type A 3 or D 3 , $ x fl &(X) = and $ 2 is of type 
A x Ai or D 2 . 
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Remarks 4.3. We offer comments which help simplify the proofs of Lem- 
mas EM EM EM and EJ\ 

(a) All Levi subgroups of type B 2 are conjugate and, unless G = D n , 
all Levi subgroups of type A 3 are conjugate. Thus, to apply Theorem |3] 
one often only has to verify that $1, $1 n $ 2 and $ 2 H <3>(L) are of 

the required type. We will construct each $j by giving a base a, /3, ... 
and setting $, equal to all the Z-linear combinations of a, (3, . . . which are 
in $(Cr). (b) Let A(G) and A(G) be the Dynkin diagram and extended 
Dynkin diagram of G respectively. Label the nodes of A(G) using a%, . . . , 
a n as in |2J. In each of the following Lemmas we will assume that A(X) 
has been produced from A(G) by the Borel-de Siebenthal algorithm PQ. Let 
X = X ni X n2 ■ ■ ■ with each X n . equal to D x , T\ or a simple factor of X, as 
listed in Table with n* the rank of the factor. We take A(X ni ) equals to 
if X ni equals T\ or D\ and otherwise A(X ni equals the first n\ nodes of 
A{Gi) or A{Gi) as appropriate. We then repeat this procedure, starting 
with A(X n2 ) and the last n 2 + n 3 + . . . nodes of A(G). This procedure 
determines A(G) — A(X) which, in turn, provides an easy description of 
$(X). For example, suppose that G = D n and X = D ni D n2 . Then A(G) — 
A(X) = {a ni } and $(X) equals all the roots in which have a ni - 

coefficient equal to or ±2. (c) Given a, (3 £ A(G) the path connecting a 
to (3 is the shortest such path and includes a and (3. The sum over this path 
means the sum of each element of A(G) which is contained in the path. It 
is easy to check that such a sum is itself a root. 

Lemma 4.4. Let G = A n , X = A ni A n2 A n3 A n4 T 3 and P e {Pi \ 2 < i < 
n — 1}. Then there exist $i and $ 2 of type A 3 as in Theorem EJ(ii). 

Proof. We have A(G) - A(X) = {a ni+1 , a ni+n2+2 , a ni+n2+n3+3 }. Let $i 
have root base given by a equal to a ni +i, (3 equal to the sum over the 
path connecting a„ 1+2 to a ni+rt2+2 , and 7 equal to the sum over the path 
connecting a ni+n2+3 to a ni+n2+n3+3 . 

For Li let $ 2 have root base given by a = aa-i, [3 = aj, and 7 = ctj+i. □ 

Lemma 4.5. Let G = B n and(X,P) G {B ni D n2 D m , A m A n2 T 2 }x{P 1 , P n }. 
Then there exist $1 and $ 2 of type B 2 as in Theorem E](i). 

Proof. One may proceed as in the proofs of Lemmas 14.41 and I4.8| or as in 
H Corollary 7.2 (ii)]. □ 

Lemma 4.6. Let G = C n . If(X,P) E {A m A n2 C n3 T 2 } x {P x ,P n }, then 
there exists $1 = $ 2 of type B 2 as in Theorem^}). If(X, P) G {C ni C n2 C n:j C, 
(in > 1), A ni C n2 C n3 Ti {rii > 1)} x {P n }, then there exist $1 and $ 2 of type 
A 3 as in Theorem El(ii) ■ 



W. Ethan Duckworth 
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Proof. One may proceed as in the proofs of Lemmas 14.41 and 14.81 □ 

Lemma 4.7. Let G equal D n . If(X,P) equals (D ni D n2 D n3 , Pi), oris in 
{A ni D n2 D na Ti (m > 1), D ni D n2 D n3 D n4 } x {P n _i, P n }, then there exists 
$i = $2 of type A3 or D% as in Theorem 

Proof. One may proceed as in the proofs of Lemmas 14.41 and 14.81 □ 

Lemma 4.8. Let G = D n , X = A ni A n2 T 2 (m >l),Pe {P n -u PJ- If 
n = 4 we assume that (X,P) is not equal to either (P 2 ,3 ; P&) or (L 2i4 , P 3 ). 
Then there exists $1 and $2 of type A 3 or D 3 as in Theorem |31(ii) . 

Proof. By our convention with subsystems of type A ni in D n , we have that 
X G {Lj >n _i, L it n} where % — n\ + 1 satisfies 2 < i < n — 2. 

Let (X, P) = (Lj )n , P n ). Let $1 = $2 have root base given by a equal 
to the sum over the path connecting a\ to a n _i, (3 equal to a n , and 7 equal 
to the sum over the path connecting a 2 to a n _ 2 - 

By symmetry the conclusion holds also when (X, P) = P n _i). 
This leaves the cases (X, P) G {(Lj >n _i, P n ), (iv ijTl , P n _ x )}. If n is odd then 
Lj >n _i is conjugate to whence the conclusion holds. It remains to prove 
the existence of $1 and $2 when n > 6 is even. If necessary we replace X 
by a conjugate to assume that i < n — 3. Let (X, P) = (L^ n -x,P n ) with 
2 < 2 < n — 3. Let $1 = $2 have root base given by a equal to the sum over 
the path connecting an to a n _ 3 , (3 = a n _ 2 + ct n -i + a n , and 7 equal to the 
sum over the path connecting ctj_i to a n ^ 2 - By symmetry the conclusion 
also holds when (X, P) = (L» in , P n -i)- □ 
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